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ASYMPTOTIC EXPANSIONS FOR SUMS OF BLOCK- VARIABLES 
UNDER WEAK DEPENDENCE^ 

By S. N. Lahiri 

Iowa State University 

Let {Xi}^_^ be a sequence of random vectors and Yin = /in (^i,f ) 
be zero mean block-variables where Xi^e = {Xi, . . . ,Xi+e^i),i > 1, are 
overlapping blocks of length £ and where fi„ are Borel measurable 
functions. This paper establishes valid joint asymptotic expansions 
of general orders for the joint distribution of the sums '^"^-^ Xi 
and X/ILi ^™ under weak dependence conditions on the sequence 
{Xi}^_^ when the block length £ grows to infinity. In contrast to 
the classical Edgeworth expansion results where the terms in the ex- 
pansions are given by powers of n"^''^, the expansions derived here 
are mixtures of two series, one in powers of n~^^^ and the other in 
powers of [y]"^'''^. Applications of the main results to (i) expansions 
for Studentized statistics of time series data and (ii) second order 
correctness of the blocks of blocks bootstrap method are given. 

1. Introduction. Let {Xjjjgz be a sequence of R'^o-valued (do G N) ran- 
dom vectors such that EXi = for all i € Z, where Z = {0, ±1, ±2, . . .} and 
N = {1,2,...}. The sequence {Xi}i^z need not be stationary. Let Xi,£ = 
{Xi, . . . , i, ^ G N, denote (overlapping) blocks of length £ for some 

given integer i = in€ [^,n] and let 

(1.1) Yin = finUi/), i,nEN, 

denote the block- variables, where fin '■ M'^"^ — > R'^^ ,di € N, are Borel-measurable 
functions such that EYin = for all i,n € N. Let 6 = \n/i'\ , where for any 
x S M, [x] denotes the smallest integer not less than x. The main results of 
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the paper give asymptotic expansions for the scaled sums 

(1.2) 5„= -=^X;,^^y/J n>l, 

under some weak dependence conditions on {Xj}jg2 when becomes un- 
bounded as n — > oo. Here and in the following, d = do + di denotes the 
dimension of S„, and A' denotes the transpose of a matrix A. The block- 
variables Yin serve as basic building blocks for many important statistical 
methods used in the analysis of weakly dependent time series data. Some 
important examples are given below. 

Example 1.1 (Spectral density estimation). Suppose that {Xi}i^z is a 
second-order stationary process with values in M such that J2'k^=o |7(^)I < oo, 
where ^(k) = Cov{Xi,Xi^k),k > 0. Then {Xi\i^i has a spectral density 
/:(— 7r,7r) — > [0,oo). A general class of nonparametric estimators of / (cf. 
Priestley [26]) is given by 

I 

(1.3) /„(A) = (2^)-i^a;fc„7„(/c)cos(A:A), AG(-^,7r), 

fc=0 

where LOkn G are nonrandom weights and where for < < n — 1, 7n(^) = 
J27=i -^i-^i+k — X^ is a version of the sample lag- A: autocovariance. The 
estimator /„ plays a fundamental role in the frequency domain analysis of 
time series data; see, for example, Priestley [26]. Note that /„ of (1.3) can be 
expressed as a function of the sum Sn of (1.2) where the block variables 
are given by Yin = Xi[J2l.^QUJiknXi^k cos{k\)], 1 <i <n, for some suitable 
constants tJikn S M, depending on the tOknS. 

Example 1.2 (Block bootstrap methods). Let 9n = tn(Xi, . . . ,X„) be an 
estimator of a parameter of interest S R where t„ is a symmetric function of 
its arguments. For estimating the distribution of On, Kiinsch [16] and Liu and 
Singh [23] proposed the moving block bootstrap (MBB) method. We now 
briefly describe the MBB for later reference. Let i = in £ (^,n) be a given 
integer such that (for simplicity) n/£ £ N, and let Xi ■ ■ ■ iXl e selected 
at random, with replacement from the "observed" blocks {xi/, ■ ■ ■ ,XN,i} , 
where b = \n/£] = njl and iV = n - ^ + 1. Let 6*; = tn(Xl, . . . ',X*) denote 
the MBB version of 0„ , where X^ , . . . , X* are elements of the resampled 
blocks Xi lA ^ i ^ b. Then the MBB estimator of the distribution function 

Gn(x) = P(On < x) of 9n is given by 

Gn(x)=P(e:^<x\Xi,...,Xn), 

the conditional distribution function of 0* , given Xi , . . . , X2 , and the MBB 
estimator of a functional of Gn is given by "plugging in" (?„ for G„. Since 
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xl I, ■ ■ ■ ,Xb e conditionally independent and identically distributed (i.i.d.) 
with Pr(x^ £ = Xi,i) = N~^, 1 < i < iV, it follows that Gn{x) and its function- 
al can be represented as functions of the block- variables Yin = finiXi,i)i 1 ^ 
i < N, for suitable functions fin (with Yin = for + 1 < i < n). For exam- 
ple, if do = 1 and 0„ = 't-"^ X^iLi sample mean, then it is easy to 
check that the MBB estimator of the variance of 9n is given by 

TV / TV \ 2n 



(1.4) al = n 



where Uii = Uiin = {Xi -!-••• + Xj_|.f„i)/ \/l is the scaled sum of the ith block 

The subsampling method of Politis and Romano [25] and Hall and Jing 
[13], and the block empirical likelihood method of Kitamura [15] are other 
important examples of resampling methods that naturally lead to sums of 
bio ck- variables . 

Example 1.3 {Studentized statistics). Suppose that do = 1 and {Xi}i^i 
is stationary. Let On = H{Xn) be an estimator of = H{EXi), where iif : M — > 
M is a smooth function. This is a version of the "smooth function" model 
(cf. Hall [11]) that covers many commonly used estimators. For constructing 
confidence intervals for 6, one considers the approximate pivotal statistic 

(1.5) Tn = V^iOn - e)/fn, 

where is an estimator of the asymptotic variance of ^/n(Qn — d). For 
example, we may use = h{Xn)dn where h{-) denotes the derivative of H{-) 
and dn is either 27r/„(0) of Example 1.1 or the scaled bootstrap estimator 
n&n of Example 1.2 above. In both cases, T„ is a function of the sum Sn- 

The examples above show that the scaled sum 5„ of (1.2) plays a fun- 
damental role in statistical inference for weakly dependent processes. In a 
seminal paper, Gotze and Hipp [8] derived asymptotic expansions for the 
scaled sum Sin of weakly dependent random vectors under an exponential 
mixing condition. This paper builds upon the work of Gotze and Hipp [8] and 
proves asymptotic expansions for the augmented sum Sn, under a similar 
general framework. The proofs of the main results are based on some ex- 
tensions and refinements of the techniques developed by Gotze and Hipp [8] 
and Lahiri [17]. 

To highlight some of the major differences between the present problem 
and the case of the regular sum Y17=i Xi treated by Gotze and Hipp [8] and 
others, note that even when the Xis are strongly mixing at an exponential 
rate (e.g., as in [8]), the block- variables {linliLi, being defined on overlap- 
ping blocks of length ^, in general have a strong mixing coefficient equal to 
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one for all lags of order < {i— 1). Since £ — > oo with n [in this paper, i could 
grow as fast as 0{n^~'^) for a given k G (0,1)], this leads to a very strong 
form of dependence among an unbounded number of neighboring block vari- 
ables YinS, thereby destroying the weak dependence structure of the original 
sequence {Xi}i^z- The "local strong dependence" of the Yin's has a nontriv- 
ial effect on the accuracy of approximation and on the growth rate of the 
variance of J27=i^in- Indeed, the sum of Yi^s over a block of size i is of 
the order Op{i) compared to the order Op(£^/^) for weakly dependent vari- 
ables and hence, the componentwise variance terms of X^ILi ^in typically 
grow at the rate 0{n£). This leads to the normalizing constant 
for the sum J27=i^in in (1-2) ■ Intuitively, the "local strong dependence" of 
the YinS makes the sum J2i=i^in essentially behave like a sum of 0{n/i)- 
many "approximately independent" variables. As a result, the accuracy of 
an (s — 2)-order asymptotic expansion for Sn is only o([n/£]~('^~^^/^), which 
should be compared to the order o(n~^'^~^^/^) for Sin- Further, in contrast 
to the case of 5i„, asymptotic expansions for Sn of (1.2) are now given 
by a mixture of two series of terms, one in powers of n'^^"^ (correspond- 
ing to -^J2i=i-^i) ^'^'^ other in powers of [n/i]~^/'^ {corresponding to 

^ELl^in)- 

The main results of the paper give an (s — 2)th order expansion for Ef{Sn) 
for Borel-measurable functions / — > M for any integer s > 3. For smooth 
functions /, expansions for Ef{Sn) are established without requiring any 
type of Cramer's condition. For i.i.d. random vectors, such results were first 
proved by Gotze and Hipp [7] for the regular sum Yll^=i^i- Further, mod- 
erate deviation bounds for Sn are also proved in Section 2 below. In each 
of these results, the block length variable I is allowed to go to infinity at a 
rate 0{p}~'^) for an arbitrarily small k > 0. 

Three important applications of the main results are considered in Sec- 
tion 3. The first result establishes moderate deviation bounds for the MBB 
moments. These bounds are useful for studying accuracy of MBB variance 
and distribution function estimators. The second result gives a general 
order Edgeworth expansion (EE) for a version of the Studentized sample 
mean, where the conditional Cramer condition is verified explicitly. It may 
be noted that the standard EE theory based on sums of /inzie-dimensional 
random vectors has severe limitations in this problem, as the Studentizing 
factor in the dependent case is no longer a smooth function of finitely many 
sample means. A second notable feature of this EE result is that the (s — 2)- 
order (s > 3) expansion for the Studentized sample mean is proved here 
solely under a conditional Cramer condition on the variables Xj's. This is 
in sharp contrast to the i.i.d. case, where some additional conditions, like 
a Cramer condition on the joint distribution of {Xi,Xly , are required (cf. 
Bhattacharya and Ghosh [2]). Intuitively, here the block variables become 
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subjected to a central limit theorem (CLT) effect due to block averaging, 
and this entails the required conditional Cramer condition for the joint dis- 
tribution of the linear and quadratic parts. 

The third application of the main results of Section 2 is to studying higher- 
order properties of the blocks of blocks bootstrap (BOBB) method of Politis 
and Romano [24]. It is shown that under some regularity conditions, the 
BOBB approximation to a class of Studentized statistics is second-order 
correct (s.o.c), that is, it is more accurate than the limiting normal distri- 
bution. This result is particularly useful for constructing s.o.c. confidence 
intervals for infinite-dimensional parameters of the underlying process, such 
as the spectral density. 

The rest of the paper is organized as follows. Section 1 concludes with a 
brief literature review. Section 2 gives the main results on expansions for 5„, 
while Section 3 gives results on the MBB moments, the Studentized sample 
mean, and the BOBB method. Proofs of all the results are given in Section 
4. 

There is a vast literature on asymptotic expansions for Sin and for statis- 
tics that are smooth functions of Sin- A detailed account of the theory for 
sums of independent random vectors is given in Bhattacharya and Ranga 
Rao [3] . The theory under the "smooth function model" is treated by Bhat- 
tacharya and Ghosh [2], Skovgaard [27] and Hall [11], among others. For 
sums of weakly dependent random vectors, Gotze and Hipp [8] obtained ex- 
pansions under a very flexible framework. Applicability of [8] results in differ- 
ent time series models has been verified in [9]. Lahiri [17] relaxes the moment 
condition used by Gotze and Hipp [8] and settles a conjecture of [8] on the 
validity of expansions for expectations of smooth functions of ^i^. Expan- 
sions for Sin under polynomial mixing rates have been given by Lahiri [18]. 
EEs for Studentized statistics under weak dependence are given by Gotze 
and Kiinsch [10] and Lahiri [19] to the second order for general weakly de- 
pendent processes, and by Velasco and Robinson [30] to higher orders for 
Gaussian processes. EEs of a general order without the Gaussian assumption 
have recently been established in Lahiri [21]. 

2. Main results. Let {Xjjjg^ be a sequence of (possibly nonstationary) 
zero mean M*^" -valued random vectors (as in Section 1) and let Yin, i^^,n> 
1, be as defined in (1.1). In this section, we establish asymptotic expansions 
for the scaled sum Sn of (1.2) under a framework similar to [8]. Suppose that 
the Xj's are defined on a probability space {Q,T,P) and that {'Dj}'j^_^ 
is a given collection of sub-cj-fields of J^. Let = cr{{'Dj : j ^ 1>,p < j < 
q}), —CO < p < q < oo. For k = 1, . . . ,b, define 
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(2.1) 



where b = \n/f\ and x Ay = min{x, y}, x,y €M. Let ||x|| = (xf H h x\Y^'^ 

and |x| = l^il + • • • + X = (xi, . . . ,rEfc)' G M'^ and let \B\ denote the size 
of a set B. Let h = n/l. For notational simplicity, we drop the subscript n 
in 6, 6. Unless otherwise stated, the limits in the order symbols are taken 
by letting n ^ oo. 

Conditions. 

C.l. There exists k € (0, 1) such that nlogn <t< K~^n^~'^ for all n > k,~^ . 
C.2. (i) There exist p G (0, oo) and s G {3,4, . . .} such that 

(2.2) mcix{Ehs{\\Ykn\\),Ehs{\\ViXkn\\)}<P for all 1 < A; < 6, n > 1, 

where hs{u) = u^[log(l + u)]°'^^\u > 0, and a{s) = 2s^ . 
(ii) For alH > 1, n > 1, EXi = = EYin, and 

(2.3) lim CoviSn) = '^oo exists and is nonsingular. 

Further, there exists a k G (0, 1) such that inf||4j|=i t' Cov(X^'J-^-^-|^ Wjn)t > 

Km for all integers jQ,m,n with < jo < b — m, < m < \/b and 
n > . 

C.3. There exists k G (0, 1) such that for m,n> and for i > 1, 1 < i < ra, 
there exist a Pj^™-measurable Xj ^ and a P*l™~''^-measurable Y^^ ^ such 
that 

(2.4) max{i?||X, - xlj\,r' E\\Y,n - Y^^Jl} < exp(-K7n). 
C.4. There exists a constant k G (0, 1) such that for all m G N, 

svLp{\P{AnB)-P{A)P{B)\:AeVi^,B e V^^,ie Z} < K-iexp(-Km). 

C.5. There exists a constant k G (0, 1) such that for all k,r,m = 1,2, .. . 
and AGVj with i < k < r < j and m > 

E\P{A\Vj:j ^ [k,r]) - P{A\Vj:j £[i-m,k)U (r, j + m])| 

< exp(— Km). 

C.6. There exist a G (0, oo), k, G (0, 1) and sequences {m„} C N and C 
[1, oo) with + m„6-i/2 = o(l), d„ = 0(^ + 6'^) and d^m^ = 0(6i^'') 
such that 



max sup E 



/|exp ^it' 



jo+m.„ N 

E(exx)\tt' ^i" 



< 1 — K for all n > K 



(2.5) 

where J„ = {m„ + 1, . . . , 6 - m„ + 1}, A„ = {t G M'^ : Kd„ < ||i|| < [b" + 
and V,, = a{{V,:j G Z, j ^ [(jo - {jo + L^J + 1)^]}- 
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Now we comment on the conditions. C.l is a growth condition on the 
block length i and covers optimal block sizes in most applications. For ex- 
ample, for an exponentially strongly mixing process, the optimal block size 
for the spectral density estimation problem (cf. Example 1.1) is O(logn), 
while for the block bootstrap estimation of variance and distribution func- 
tions (cf. Example 1.2), the optimal block lengths are of the order n^^^ 
for /c = 3,4, 5 (cf. Hall, Horowitz and Jing [12]), all of which are covered 
by C.l. Next consider C.2-C.6. As in [8], here we formulate the conditions 
in terms of the auxiliary cr-fields Dj in order to allow for greater gener- 
ality. Condition C.2(i) is a moment condition on V^X^^ and Y^-n that is 
optimal up to the logarithmic factor. Since hs{-) is convex and nondecreas- 
ing, Ehsi\\Ykn\\) < Y.ii{k-i)e+i Ehs{\\Yin\\) , and a sufficient condition for 
(2.2) is max{i?/is(||yj„||) : 1 <i< n,n > 1} < p. Equation (2.3) ensures a 
nondegenerate normal limit for Sn with the given scaling constants. If the 
process {Xi}^_^ is second-order stationary and if, for each n > 1, the col- 
lection is also second-order stationary, then the last part of C.2(ii) 
follows from (2.3). Condition C.3 connects the variables Xi and to the 
strong-mixing property C.4 of the auxiliary u-fields "Dj. For suitably well- 
behaved functions fin, the bound on ~^la,mll follows from the bounds 
on the — xj^||'s. C.5 is an approximate Markov property. 

Finally, consider the conditional Cramer condition C.6, which is weaker 
than a direct analog of the conditional Cramer condition of [8] for the sum- 
mands in Sn on two counts. First, the range of values of t in (2.5) has 
a lower bound, namely, ndn, that may tend to infinity at a suitable rate. 
By setting (i„ = 1 for all n > 1, one gets the more standard version of the 
Cramer condition, as formulated by Gotze and Hipp [8]. Second, the con- 
ditioning o"-field T>jg in (2.5) is only a sub-a-field of the standard choice 
= a{{Vj Jo}) (cf. (2.5) of [8]). Indeed, if P*^ C J" is a a-field 

of containing T>jg, then one can show (cf. Lahiri [22]) that a sufficient 
condition for (2.5) is given by 



(2.6) max sup E 

jo&Jn t£A„ 



{/ jo+m„ \ 
expLt' J2 ^jnj 



Jo 



< 1 



Indeed, these two refinements allow us to establish valid EEs for the Stu- 
dentized sample mean solely under Gotze and Hipp's [8] Cramer condition 
on the Xj's (cf. Section 3.2). 

Next define the functions P^.n {t) for t S M'^ by the identity (in n S M) 

(s \ oo 

r=3 / r=l 
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where Xrn{t) denotes the rth cumulant of t' Sn [multiphed by (t)''], defined 
by 



(2i 



d 



Xr,n{t) = — log Eexp{iUt'Sn 

aw 



u=0 



Under C.1-C.5, the Pr^„(t)'s are bounded for each t. Define the (s — 2)th or- 
der EE ^s,n of Sn through its Fourier transform ^s,n{t) = J e''^'^d^s,n{x),t € 
R'^, by ' 

s-2 



(2.9) '!',,„(*) =exp(x2,n(t)/2) 



r=l 



Next, let So = 2[s/2j and for any positive definite matrix A of order /c G N, 
let and $(•; A) both denote the normal distribution on M^' with mean zero 
and covariance matrix A. Then we have the following result on expansions 
for EfiSn). 

Theorem 2.1. Assume that conditions C.1-C.6 hold for some a> {s — 
2)/2 in C.6. Let /iM"^— >M be a Borel measurable function with Mj = 
sup{(l + ||x||*°)~^|/(x)| : X G M*^} < oo. Then there exist constants Ci = Ci{a), 
C2 G (0, 00) (neither depending on f) such that for all n> C2, 



(2.10) 



Ef{Sn)- / /d^s,n 



<CMf-X'') + C2Mfb-^'-^^'^{\ogn)~^, 



where f{x) = /(x)/(l + ||x||*o),x G , and Lo{f;e) = /sup{|/(x + y) 
/(x)|:||y|| <e}$(dx;Hoo), e>0. 



A direct consequence of Theorem 2.1 is that sup^g^ \P{Sn G ^4) — ^s,n(^)| = 
0(6~''*~^^/^(log?i)~^), where C is the collection of all measurable convex sets 
in M'^. 

Next consider expansions of Ef{Sn) when / is smooth. When the Xj's 
are i.i.d., Gotze and Hipp [7] established an (s — 2)th order expansion of 
Ef{Sin) for / G C*~^(]R'^"), without any Cramer type conditions, where 
C"'(M'') denotes the set of all r-times continuously differentiable functions 
from R*^ to M, r > 0, /c G N. For weakly dependent Xj's, Lahiri [17] proved a 
similar result for Ef{Sin) for / G C"'~^(R'^o), settling a conjecture of Gotze 
and Hipp [8]. In the same spirit, Theorem 2.2 below establishes validity 
of an (s — 2)th order expansion for Ef{Sn) for / G C*~^(M'^), without the 
conditional Cramer condition C.6. To state it, let = ^1"! /dtl^ ■ ■ ■ dtl" , for 
a = (ai, . . . , Uk)' G (Z+)^', G N, where Z+ = {0, 1, . . .}. 

Theorem 2.2. Assume that conditions C.1-C.5 hold. Let f:R'^^R 
be a function such that (i) / G C**~"'^(M'^) and (ii) for each a G (Z+)'^ with 
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< |a| < s — 1, there exists a p{a) € with p{0) = sq, such that Mj^a = 
sup{|L>"/(3;)|/(l+ :2; G W^] < oo. Then there exists a constant C3 G 

(0,00), depending only on s,d,p,K and on {Mj^^ -1(^1 — 1}, such that 

<C36^('~2)/2QQg^)-2 for all n> 2. 

The next result is a moderate deviation inequality for Sn and its moments 
up to order sq. Let 1{B) denote the indicator of a set B. 

Theorem 2.3. Let Xq denote the largest eigenvalue o/Hqo- Then under 
conditions C.1-C.5, for any A > Aq, there exists a constant C4 G (0, 00), 
depending only on s, d, A, p, k, such that for all n > 2, 

E{1 + \\SnDt{\\Sn\\ > [(s - 2)Alog?i]i/2) 

(2.11) 

<C46-(^-2)/2(logn)-2. 

For the regular sum Sin, sharper bounds are available (cf. [8, 17]). Let 
Ai be the largest eigenvalue of Hi^i = lim„„»oo Cov(S'i„,). Then Lahiri [17] 
proved that ^(1 + ||5i„||^«)l(||5i„i| > [(s - 2)Alogn]i/2) = o{n-^'-^^l'^) for 
A > Ai. For the marginal distribution of the following bound is slightly 
better than (2.11) (as A2 < Aq). 

Theorem 2.4. Suppose that ^2,2 = limn-»oo Cov(5'2n) exists and is non- 
singular, and conditions C.1-C.5 hold for Yj^s only. Then, for any A > A2, 
there exists a constant C5 G (0,00), depending only on s,d,X,p,K, such that 
for all n>2, 

E{1 + ||52„,|r«)l(||52n|| > [{s - 2)Alogn]i/2) < C5b~^'~^^/\lognr\ 

(2.12) 

where A2 is the largest eigenvalue o/S2,2- 

[21 

Remark. Analogs of Theorems 2.1-2.4 are known for the sum Sn — 
(^Er=i^.',^Eti(^i")')', where ^ j G N, denote the 

block-variables based on nonoverlapping blocks of length L See [22] for de- 
tails. 

3. Applications. 

3.1. Moderate deviation hounds for MBB moments. Let {Xjjjgz be an 
M'^°-valued stationary process. As described in Example 1.2, let Uu = 
{Xi + • • • + Xi^^^i) / \fl denote the scaled-sum of the XiS in the ith block 
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= [Xi, . . . i > 1. For G i'^+Y" , we define the z^th MBB mo- 

ment as 

TV 

(3.1) (in{v)^N-^Y.U'(^^ 

i=i 

where N = n — i + 1. For estimators On that can be represented as smooth 
functions of means, the MBB estimators of Var(0„) and the distribution of 
Studentized On can be approximated through functions of the MBB mo- 
ments. For example, the MBB variance estimator for the sample mean 
On = Xn for do = 1 is given by al = n-^{jln{2) - [cf. (1.4)]. Simi- 

larly, the leading terms in the two-term EEs of the MBB distribution func- 
tion estimators of the normalized and Studentized sample means are rational 
functions of /i„(z/),l < < 3 (cf. Lahiri [19, 20], Gotze and Kiinsch [10]). 
As a result, moderate deviation bounds on the MBB moments are impor- 
tant for investigating accuracy of such MBB estimators. The following result 
gives a moderate deviation bound for (in{i^)- 

Theorem 3.1. Suppose that v e N'^", EXi = 0, and that conditions C.l, 
CA, C.5 hold and that condition C.3 holds for the XiS only. Also, suppose 
that = lim„^oo Var(6^/^/i„(z^)) G (0, oo) and that 

(3.2) PEE '?{log(l + llXilD^W) < oo 

for some 7(5) > and (7 G N with 2q > s|z^| . Then, for any X > Xs^i^), there 
exists a constant Cq = Cq{u, d,s,K,X) G (0, 00) such that for all n>2 

E[{l + \Vb{finil^)-EU^,)n 

(3.3) X l{\Vb{fin{i^) - EU^^)\ > [{s - 2)Alogn]V2)] 

<C,b-^'-'^/\\ogn)-'. 

For an exact expression for A3(z^), see [22]. The following result is a simple 
consequence of Theorem 3.1 and serves to illustrate how the bounds on the 
/i„(i^)'s can be used for deriving similar bounds on the MBB estimators of 
population parameters, such as on the MBB estimator o"^ = n~^(/i„(2) — 
[An(l)]') ofVar(X„). 

Corollary 3.1. Suppose that do = 1 and that the conditions of Theo- 
rem 3.1 hold with v = 2. Let A„ = ri[(T^ — Edn]- Then for any X > 2A3(2), 
there exists a constant Cj = 6*7(5, k, X) G (0, 00) such that for any n>2, 

E[{1 + [Vh\kn\r)t{^/h\Kn\ > [{s - 2)Alogn]i/2)] < C7r('^-2)/2(logn)-2. 
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3.2. Expansions for the Studentized sample mean. Let {Xi}i^z be a real- 
valued (i.e., do = 1) stationary process. As an application of the main results 
of Section 2, here we establish EEs for a version of the Studentized sample 
mean, given by 

(3.4) Tn = n^/\Xn-EX^)/dn, 

where = max{n-^ X^Li - {b~^T,i=iUi{i-i)e+i)?} is the_ 

nonoverlapping block bootstrap (NBB) (cf. Carlstein [4]) estimator of nVar(Xn) 
based on blocks of length i, truncated from below at n^^ and where b = n/i 
(assumed to be an integer, for simplicity). We also assume that 

(3.5) i ~ /?on^/3 for some /?o £ (0, oo), 

where, for {«„}„>!, {'t;n}n>i G (0,oo), we write n„ ~ Vn if lim„^ oo '"n/'^n 
= 1. Note that (3.5) covers the optimal block size for estimating Var(X„) 
by the NBB (cf. Hall, Horowitz and Jing [12], Lahiri [20]). Since the block 
variables in this problem are smooth functions of the Xj's, we may impose 
regularity conditions on the Xj's directly, without any reference to the block 
variables. 

Conditions. 

5.1. {Xi}i^z is stationary, p = S|Xi|2(^+i){log(l + |Xi|)}tW G (0,oo) for 
some s > 3, s G N and 7(5) > s^, EXi = and cj^ = J^if^z^^o^i G 
(0,00). 

5.2. (i) The cr-fields Vj are generated by a sequence of independent d2- 
dimensional {d2 G N) random vectors Zj, that is, Vj = a{Zj),j G Z. 

(ii) There exists k G (0, 1) such that for all m> k^^ and j > 1, there 
exists a Pj]!^^-measurable xj^^ such that — xj„j|p < exp(— Km). 

(iii) There exists k G (0, 1) such that for all m, jo G N with <m < 

jo, 

sup{E\E{exp{Lt[Xj^^.^ + ■■■ + Xj^+rn])\'Dj -.j / jo}| : |t| > k} < 1 - K. 

Condition S.2(iii) is the conditional Cramer condition introduced by [8] 
for deriving valid asymptotic expansions for Sin ■ Validity of a general order 
EE for the Studentized mean r„ under S.2(iii) is somewhat surprising as 
the validity of a similar expansion for the Studentized sample mean for i.i.d. 
variables requires a stronger version of the Cramer condition that involves 
both the linear and the quadratic parts. This phenomenon can be explained 
by noting that in the dependent case, the block variables Uu tend to behave 
like their limit, that is, like N{0,a'^) variates as the block size ^ — > 00 and 
the (stronger) Cramer condition for the bivariate random vector {Zoo,Z^y 
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holds when Zqo is a A^(0, cj^) variate. We now describe two important classes 
of weakly dependent processes for which condition S.2 holds. See [8] and [9] 
for more examples. 

Example 3.1 {Linear processes). Let Xj = Y^i^z^^i^j-id ^ ^) where 
{^ijiez are i.i.d. random variables with £"£1 = and = Eel S (0,oo), 
and where {ajjjgz G M is such that X^jg^aj / and for some k £ (0,oo), 
\ai\ = 0(exp(— as |i| 00. Then S.2 holds with Vj = a{ej),j £ Z, 
provided < 00 and ei satisfies the usual Cramer condition (cf. [8]) 

limsup|j|^o^ |£^exp(itei)| < 1. 

Example 3.2 {m- dependent processes). Let Xj = . . . , ej+mo-i)) 
z e Z, where {ei}i^z are i.i.d. random variables with Lebesgue density /e, 
mo E N, and hg E C^{W^°). Then, {Xi}i^z is an mo-dependent process. In 
this case, condition S.2 holds with Vj = (j{ej), and = Xj for m > mo, 
j E Z, provided (cf. [8]) that there exist points yi, . . . , y2mo-i ^ ^ and an 
open set O C M such that yj E O for all I < j < 2mo — 1, the density fg is 
strictly positive on O and / Ej"L°i ^hg{xi, . . . , rE^o)l(xi,...,x™o)=(y,.,...,%+mo-i)- 

The following is the main result of this section. Write (j){x) and ^{x) to 
denote the standard normal density and distribution function, respectively. 

Theorem 3.2. Suppose that (3.5) and conditions S.l and S.2 hold. 
Then there exist polynomials PmA ^ < s — 2, with hounded coefficients 
such that 

( s-2 



sup 



P{Tn <x)-\ $(X) + n-''l^prn{x)(t>{x) 



r=l 



0(n-(^-2)/3(logn)-2). 



The coefficients of pm are 0(1) as n — > 00 and typically contain smaller- 
order terms. For example, the third-order EE for T„ (with s = 5) has the 
form 

P{Tn<x)= r cP{y)[l + {n-^/^pi{y) + n-^/^p2{y)+n-^/^p3iy) 
J —00 

+ n~^I^Pi{y)+n^^P5{y)]dy 

+ 0(n"^(logn)"2) 

uniformly in x E M, where the pj's are some polynomials whose coefficients 
are rational functions of the moments of the block variables Uu. In partic- 
ular, for y E M, 



Pi{y) = {y^ - 1) 



^feCov(Xi,Xfc+i] 
Lfc=l 



EXPANSIONS FOR DEPENDENT SUMS 



13 



P2{y) 



3 



{EZl){l''^EZnVn) 



X (y'-3y), 



where Z„ = n^/^iXn - EXi) and Vn = h^^'^YA=i[Uli - EUl^]. As in the 
independent case (cf. Bhattacharya and Ghosh [2]), the terms in the EEs can 
be derived by "formally" expanding the cumulant generating function of the 
polynomial stochastic approximation to the Studentized statistic, and then 
by Fourier inversion of the resulting series. See Lahiri [21] for more details. 
Note that, as mentioned in Section 1, the expansion for the Studentized 
sample mean here is a combination of two series in powers of and 
n~^/^, the first corresponding to the (cumulants of the) Studentizing factor 
and the second coming from the expansion for Sin- 

3.3. Second-order correctness of the blocks of blocks bootstrap. For boot- 
strapping estimators of infinite-dimensional parameters of a weakly depen- 
dent process, Politis and Romano [24] formulated the BOBB method, (a 
version of) which is now described briefly. Given let lin = 

fin{Xi,i)i'^ = 1, . . . , A^, be a set of block variables based on overlapping blocks 
Xi,i of length where N = n — i + \ and the finS are Borel measur- 
able functions [cf. (1.1)]. To approximate C{Tn), the distribution of T/v ^ 
tN{Yin, ■ ■ ■ lyNn'i using the BOBB, one defines the blocks of block vari- 
ables {Bi = {Yin, ■ • ■ , y(i+fi-i)n) : i = 1, . . . , - ^1 + 1}, resamples \N/£i] 
many blocks from {Bi, . . . ,BN-ei+i} , and uses the first N resampled block 
variables {Y*^ := 1, . . . , N} (say) to define the BOBB version of Tn as = 
t]\f(Yi^, . . . , Y^^; 6), where 0„ is an estimator of 6 based on Xi, . . . , Xn- Then 
C{T*) (conditional on Xi, . . . , A„) is the desired BOBB estimator of C{Tn). 

Politis and Romano [24] established consistency of the BOBB method for 
statistics of the form Tn = h^/'^{YN - EYn), where Y/v = A^^ J2f=i Yin- We 
now show that the BOBB is indeed s.o.c. for a Studentized version of T/v, 
given by 



where = max{n-\ [7°(0) + 2j2lU{l - N-^k)^^{k)]b/N} and 7°(A:) = 
Et'iHYin - YN){Y^,+k)n -YN),k = 0,...,N-l.To define the BOBB 
version of T^, let = Efl^(^i_i)e,+iY*n, i = l,...,6i, where b^ = 



N/ii, which for simplicity of exposition is assumed to be an integer. Then 



the BOBB version of Yn is given by Y^ = 61"^ Eiii >"»n,i- And for al 



(3.6) 



Tn = Vb{YN - EYn)/' 
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we use a truncated version of the sample variance of the l^^j^'s, namely, 
[cj;]2 = max{n-\6i~i^^ijyi; i -Yj^]^}, to define the BOBB version of 
T]\f as (cf. Gotze and Kiinsch [10]) 

(3.7) n = Vh{n-ESN)/<- 

Since the rate of normal approximation to Tjy is 0(&~^/^), here s.o.c. refers 
to an error of approximation that is of smaller order than 0(6~^/^). The 
next result gives sufficient conditions for the s.o.c. of T/y. 

Theorem 3.3. Suppose that {Xi\i^i is a sequence of stationary 
valued random vectors, Yin = fn{Xi,e) for some fn iK'^"^ M. Also, suppose 
that: 

(i) for some k G (0, 1) and 5o G (0, 1/5), i < k^^u^/^ and ii < n~^n^'>i 
foralln>K~^, and \[ogn]/ i + 1/ li = o{l) asn— >oo; 

(ii) for some K ^ {^,1) and /or some inte^'er ro > 12[(1 — 55o)(4 — 5(5o)]~^ 
[where Sq is as in (i) above], supn>i E\Yin\'^^°^'^ < oo; 

(iii) o"^ = lim^^oo Var(6-^/^yAr) exists, o"^ G (0, oo); and 

(iv) conditions C.4, C.5 hold and condition C.6 holds with dn = 1 and 
An replaced by A^== {{0' , s)' : s eR,\s\> k} . Then 

(3.8) sup|P(TAr<x)-P=,(r^<x)|=op(6^^/2) asn^oo. 

Theorem 3.3 shows that for s.o.c. of the BOBB, the BOBB block size 
ii must be of a larger order than i. In addition, we also need an upper 
bound on the growth rate of ii/i. Since is defined in terms of 6i-many 
resampled blocks, its EE has an error of the order 0(61^^^^), which must 
be o(6-^/2) for the BOBB to be s.o.c. A large h can make hi too small 
compared to b and s.o.c. cannot be attained. See [22] for more details. We 
also mention that the Cramer condition (iv) is only on the sum of the block 
variables Yin, not on the joint distribution of Yin and y^j^;,)^!^^, <k < £1. 
Under this setup, the proof heavily depends on the arguments developed in 
Lahiri [19], which established a similar s.o.c. result for the MBB method in 
the ^niie-dimensional parameter case. 

For a concrete example where Theorem 3.3 can be readily applied, suppose 
that the Xj's are real-valued and that Yin = (2vr£)~^| J^jt^iT^ -^j j 
uj G [— vr, tt]. Then, Yn gives an estimator of the spectral density / of {Xi}i^z 
and it is asymptotically equivalent to the estimator (1.3) of Example 1.1 
with weights ujkn = 1 (cf. Politis and Romano [24]). In this case, o"^ exists 
and = (2/3)/2(a;) for < |a;| < tt and o"^ = (4/3)/2(u;) for u; = 0,±7r. 
Thus, condition (iii) of Theorem 3.3 holds if /(w) G (0, 00). If, in addition, 
we suppose that {Xjjjg^ is a linear process as in Example 3.1, then by 
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the arguments of Janas [14], condition (iv) holds, provided C{ei) has an 
absolutely continuous component. Thus, for this class of linear processes, 
the BOBB approximation to the distribution of the Studentized spectral 
density estimator is s.o.c. 



4. Proofs. For a;, y E M, let x\/ y = max{x, y}, xj^ = x \/ 0, and [x] = k 
if k < X < k + 1, k £ Z. Let ms = \(logn) loglog(?i + 2)] . Let a! = llj=i "i' 
and = 11^=1*°' for a = (ai, . . . ,0^)' E t = {ti,.. .,td)' E M*^. Let 

J^^ = a{Xi -.1 £'Z,a<i < c) for — cxd < a< c< oo. Let Ck,C and C(-) denote 
generic constants, depending on their arguments (if any), but not on n and 
£; dependence on dQ,di,d, K,p will be often suppressed to ease notation. 
For c > 0, define the truncation function c) iR'^ ^ M'^ by g{x;c) = ■ 

^^\\El'j-i(^x / 0), where ip E C°°(]R) is nondecreasing, satisfying ^{u) = 
for u < 1 and 'ip{u) = 2 for n > 2. Let 

lWjn = VIXjn:2Wjn = Y,n and = 2 J', l<j<b. 

With Cn = 6^/^(logn)~^, define the truncated and the centered versions of 

kWjn by kWjn = g{[kWjn];Cn), kWjn = [kWjn] - E[kWjn] and SCt kSn = 

h-^'^ E?=i[fcW^in] and kSn = h-^'^ Y.]=i[kW,n],k = 1, 2. Let W,n = {[iW,n1 , 
[2Wjn\'y and similarly, define Wjn, Sn and Sn- For any random variable (r.v.) 
Z on let 

EtZ = E[ZeMit'Sn)]/Hn{t), t E 

where Hn{t) = E exp^tt' Sn) ■ Define the semiinvariants of the r.v.s Vi, ■ ■ ■ ,Vp 
by 

}Ct{Vi,...,Vp) 

(4.1) 

__d_ _d_ 

dei dsp 



log E ex.p{Lt' Sn + eiVi H \-epVp), 

ei=--=ep=0 



t E M^. Write /Ct(Vf , V^) = )Ct{Vi, . . . , Fi, F2, ■ • ■ , ^2) where, on the right- 
hand side, Vi appears p times and V2 appears q times. Then, by Taylor's 
expansion, we get 

s 

(4.2) logHnit) = 5]/Co(t'^;) + Kit), 

r=2 

where R*n{t) = [J^{1 - vY^vt{t' ~sk^^^)dr,]/ s\. 

Lemma 4.1. Let conditions C.1~C.4 hold. Then there exists C = C{p, s, k) 
such that for any ai, . . . , E M*^ with \\ai\\ = I, 2 <r < s, and for all n > 
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(i) |/Co(a'i5,,...,a;5„) - /CoK5„, . . . < C6-(^-2)/2 ^ 

(logn)2*-2-[a{s)/s]^ 

(ii) ■ • ■ ,4^n)| < C6-('^-2)/2. 

Proof. The left-hand side of the inequahty in part (i) is bounded above 

by 

(4.3) 6-^/2 g |^^(^^.^ , . . . , y,v) - ^o(V^,i ,...,Va, 

4 = 

where the summation ^ extends over all 1 < ii < • • • < jV < & with max- 
imal gap i, and where Vj^ = a'pWj^n and V^-^ = a'pWj^n, I < p < r. Since 

M^^n e e .^(T+,-iK+i and [(z + j - l)e + 1)£] = {j - 2% 

by C.3 and C.4 above and by (3.13) and (3.14) of [8], we have (see [22]) 

(4.4) eVo(VS,,...,VSJ| <C(K,r)|J2|6'c;^exp(-3slogn). 

i>C{K) 

Truncating the WjnS at ei = exp(«:i) and using C.3 and C.4, we get (cf. [22]) 

5:l:i/co(^,„...,T^>)i 

i>io 

{i,r) 

- \^o{aig{Wj^n;ei), . . . ,arg{Wj^n;ei))\ 

i>io 

oo {i,r) ( I \ 

(4-5) + E E ^(^' P) ^^A A n WoA\^^W,un\\ > e,) U G /, 

i=io I \p£/ / 

1 < |/| <r| 

<C(p,^,r,.)C"^^)/^^ 
for all 2 < r < s, where = [log n] . Also, by similar arguments, for 2 < r < s, 

E E l^o(^,i , . . . , -tSv) - ^o(V',, , . . . , V^.JI 

i<io 

(4.6) 

< C6(log n)7{c(f-'') [log n]"(^)/^} . 

Hence, part (i) follows from (4.3)-(4.6). Proof of part (ii) is similar; see [22]. 
□ 
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For the next lemma, let Wn{I) = Hje/ 11^=1 O'jpWjn and S^p = s\^\m) = 
Lh-^IH' Y.*"" Wjn, I C {1, . . . , 6}, r > 0, m > 3, where ajp £ M"^ with \\ajp\\ = 1, 
rj G N, and where J2*^ extends over all 1 < j < 6 with \j — k\ > mr for all 
k£l. 

Lemma 4.2. Let conditions C.1-C.4 hold. Then, for any rj G (0, j), there 
exists C{r], p) > such that for every 3 <m< rjb/\I\ and 1 < K < rjb/ {m\I\), 

\H^{t)\\EtWn{I)\ < I W„(/)|[max{|Eexp(5}''))| ■.l<r<K} + if] 

(4.7) 

+ C{\I\)bcZK2^iexp{-C{K)m£) 
for all \\t\\ < C{rj, p)[b/m]^/'^ , where ^ = Yj^jTj . 

Proof. Let Ai,^ = [e^^is'f'^^ -S^)- 1] and Wij = Wn{I) exp(iri/2 ^ 

Yj^it'Wjn), r > 1. Using Tikhomirov's [29] iterative method, one can show 

that the left-hand side of (4.7) < E^Li l^^^i./dlpl Aij) exp(5}''^)| + 

l-^l^ij/dljLi Aij) exp(S'|^^)| . Now, approximating Aij's and S^^s using 

xj^^'s and yjnmo^ (with mo = [m£/12j), and using conditions C.3, C.4 

and the bound "max{£;(X;f4o+i Wjnf ■.l<jo<b-m}< C{p)m, m > 3", 
one can complete the proof. See [22] for details. □ 

Lemma 4.3. Let C.1-C.4 hold and let /i,/2 C {1, ... ,6} with min{/2} — 
max{/i} > mi for some 3 < mi <b— — |/2|. Then, given rj G (0, ^) and 
an integer m £ [3,mi/3], there exists Ci = C{p,K,T]) G (0,oo) such that 

\EtWn{Ll)Wn{l2) - EtWn{Il)EtWn{L2)\ 

(4.8) 

< C{r,k,i])bcl[K2^£exp{-C{K)me)+ri^]\Hn{t)\-^ 
for all\\t\\ < Ci [fe/m]^/^, 1 < K < mi/m, and n>l, where 7 = X]p=i ^jeip ^3 ■ 

Proof. One can prove (4.8) by using Tikhomirov's [29] method and 
arguments in the proofs of Lemma 3.1 of [17] and Lemma 4.2 above. See 
[22] for details. □ 



(4.9) 



Lemma 4.4. Let conditions C.1-C.4 hold. Given rj G (0, j) and q G 

C{s,q,p,K,r]){l+Pnma + \\tr) 



—R*^{t + xou) 



u=0 



< 



6(«-2)/2(logn)[°(^)-2s-l] 

for all \\xo\\ < 1 and for allt£ ^„ = {x G M"^: ||x|| < C{r],p, k;)^^^"''')/^, /?„(x) < 
00}, where /3„(t) = |F„(t)|-i[sup{|Eexp(5}'))| : 1 < r < Cipo)b'-'i, \L\ <po} + 
exp( — C(r/, K,po)m^£)], pQ = s + I + q, and is as in Lemma 4.2. 
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Proof. It is enough to consider ft-^/^ J^iZo E^''''^ l^ntC^ji, ■ • ■ , V,„)| for 
s + 1 < r < po and < u < 1 [cf. (4.2)], where Vj = it'Wjn and E^*'''-' is as 
in (4.3). By Lemma 4.1, for any s + 1 < r < po, Wj„||'' < cl,''-'^ EWWjnW"^^ < 
C{p, s)c;;-'(logn)-"(^), uniformly in 1 < j < 6. Next, define Ti = {i G Z : 1 < 
i < an},T2 ={ieZ:an<i<b'^} and = {i e Z-.b'' < i < b - 1}, where 
a„ = mg. Now using Lemma 4.2 (with m = \b^~\ and K = m) for z G Fi, 
Lemma 4.3 (with m = K = + 1) for i €zT2 and again Lemma 4.3 (with 
m = K = [b^\ +1) for i gTs, one can complete the proof of the lemma. See 
[22] for more details. □ 



Lemma 4.5. Suppose that conditions C.1-C.5 hold. Then, for any I C 
{l,...,b} with \I\=r< C, and for any t eW^ , 3 < m < b/C, 

\Hn{t)EtWn{I)\ < Ccl[Pin{t)f + C{K,r)Kcl[l + \\t\\em]exp{-C{K)me) 
for some K > C[b/m], where /3i„(t) = max{^|S(exp(t6-V2t'^| ._ iy.„)| 
: TTi < Jo < b—m}, 7 = J2jei'''j <^'^d Vj^ is as in condition C.6. 

Proof. Let / = {ji, . . . ,>}, Jon = {l,...,b] and Ji„ = {j G Jon : \j - 
3k\ ^ 2m + 1 for all 1 < < r}. Define jj* = inf Ji„ and j]]^^ = inf{j G 
"^in : i > ip + 7m}, p = 1,2, . . . ,K — 1, where is the first integer p for 
which the infimum is over an empty set. Also, define the variables Ap = 

eM^b-^'^t'Y.\j-f^\<rn.Wjn),Bp = eMib-^lH'Y. j0^rn+l<j<j°^^-m-l ^jn) and 



R = Wn{I) exp(i6-^/2^' X EjGJ2n ^^ere J2„ = {j G Jo„ :i < j? 

J > — m} . Then it follows that 

Hn{t)EtWn{I) = E 



m or 



n ^p^p 



L \p=2 



Let Ajj,Bjj and i?^ be defined by replacing Xj's and Yj^s by ^Iqi^jnq 
^p, -Bp and i? with q = m£ for A^, and with q = ml/12 for B^^ and i?^. Then, 
by C.2, 



(4.10) 



K-l K-1 

ER n ApBp - ER^ n A>K 

p=2 p=2 



< C{k, |/|)irc;^||t||^mexp(-c(K)m^). 



Next, let Pp = cr{{'Dj ■.j£Z,j^ [cp, dp]}) and V* = (j{{'Dj : j G [op — mi, Cp) U 
{dp, bp + m^]}), where ap = {jp — m)£ + 1 — m£, bp = {jp + m + 1)1 + m£, Cp = 
(jp - L"i/2J )^ + 1 and dp = (i° + [m/2j + 1)1, 2<p<K-l. Then, by 
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condition C.5, maxp=2,...,i^-i \E{Al\Vp) - E{Al\V*)\ < C(k) exp(-«;m£) and 
hence, 



K-1 



K-1 



ER^ n 44 -ER^ n H^i^i'^;) 



(4.11) 



p=2 
K-1 

<E 

q=2 



p=2 



ER^rYlAlB^BliAl-EiAllV,)] l[ BIE{AI\V;] 

\p=2 J p=q+l 



K-1 



+ CclY,E\E{A,\V,)-E{A\\Vl)\ 

q=2 

< C {K)a/^K exp{— Km£) , 

since by construction, i?t(j]^-i ^t^t), 5+ and H^^+i ^p-E'(^pl^p) are mea- 
surable w.r.t. "Dq for every 2 < q < K — 1, making the first term vanish. 
Now using (4.10), (4.11) and the fact that V* and ^^p+i are separated 
by a distance > Cmi for all p, one can retrace the arguments in [8] to 
conclude that \Hn{t)EtWniI)\ < CcZU^J2^ E\E{Ap\Vp)\ + C{k, \I\)KcZ{1 + 
\\t\\im)exp{—C{K)mi). Lemma 4.5 follows from this. □ 

Lemma 4.6. Let C.1-C.5 hold and r] G (0, 1). Then, for any a G Z'l, 

\D''Hn{t)\<C{a,rj,k)b\''\[exp{-C{K)\\tf)+exp{-C{K)mni)] 
for all \\t\\ <C{K,p,s)b^^-'^^/'^, wh ere m„ = [6^/^] . 

Proof. For any M'^-valued zero mean r.v. Z on P) with < 

CO and sub-u-field C C J^, one can show (cf. [22]) that \E e'xp{Lt' Z\C)\'^ < 
1 - E{{t'Zf\C) + 2E{\t'Z\^\C) for all t £ M'^. Taking Z = 6-^2 Wjn 
and using C.2 and Holder's inequality, one can show (cf. [22]) that 

^ n 2 



(4.12) 



E 



E'lexp ^it' 



c 



< exp ( '^o\\t\\ 



i=io+i 

for all ||t|| < C{k, p,s)b^^^ /niQ, provided n > k~^. Now applying Lemma 4.5 
with m = [6^/^] and using (4.12) to estimate f3in{t) of Lemma 4.4, one can 
complete the proof of Lemma 4.6. See [22] for more details. □ 



Lemma 4.7. Let conditions C.1-C.4 hold. Let f -.W^ 

easti 
7>0, 



he a Borel 



measurable function with sup{ ^jq^ppgy :x G M'^} = Mj < oo. Then, for any 



Ef{Sn)- / fd^>n, 



20 S. N. LAHIRI 

< C'(p,s,7,Soo,M/) 

^-{s-2)/2(^^Qg^^)2s-2-Ks)^] 



+ sup \D''[{Hnit)-^,,nit))Knit)]\dt + u;if-b-^] 
\a\<pi J 

where = d + sq + 1, f{x) = j^^, x G R'^, Kn{t) = Ko{^) and Kq G 
C^i(M'^) is a characteristic function that vanishes outside a compact set. 

Proof. Let Ai = {||5„|| > logn}, A2 = {H^nll > logn} and A3 = {2||5„|| > 
logri},n > 3. Then, it can be shown (cf. [22]) that 

h^\Ef{Sn)-EfiSn)\ 

(4.13) < 12Mf[{lognY^P{Sn / 5„) 

+E\\Sn\riA, + \E\\Sn\r-E\\Sn\n]. 

By Markov's inequaUty and Jensen's inequaUty, for ah n with c„ > 1, one 
gets 

b b 
PiSn ^Sn)<J2 ^(ll^^inll > C.) + ^P(||y,-n|| > Cn) 



3=1 

< pb[hsiCn)]-^ + 



b ( ji 

(4.14) <pb[hsiCn)]-^ + [hsiCn)]-^J2^\^'^ E ^-dl^-ID 

<C(p,s)6-(^-2)/2(bgn)-H^)-2^]; 

(4.15) \\ESn\\ < C(p,s)6-(^-2)/2(bgn)2(^-i)-"{^). 

Let gnix) = ||x||''o]l(2||a;|| > logn) and 5„(x) = 5„(a;)(l + ||x||''")~\x G M*^, 
n > 2. Then, for any a > 0, Lo{g; b~"-) + J gn{x) d^ s,n{x) < C{p, Eoc,a)n~"-; 
see [22] for details. Hence, by Lemma 4.1 and by (4.13)-(4.15), for all n> C, 



h<C{p,E^,s)Mf 



(log?l)2^-2-I"(«)/^l6-{^-2)/2 + 



EgniSn) - gnd^ 



Lemma 4.7 now follows by two applications of the smoothing inequality of 
Sweeting [28] and Lemma 11.6 of Bhattacharya and Ranga Rao [3]. □ 

Proof of Theorem 2.1. By Lemma 4.7, it is enough to show that for 
< |a| < pi, 



(4.16) 



\D^[{Hn{t) -i^s,n(.t))Ko{b~''mdt 
<C((i,s,p,K)6-("-2)/2(logn)-2. 
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Suppose that Koit) = for all ||t|| > Cq. Then partition the set {||t|| < 
Cob''} hy{\\t\\ < an}, {an < \\t\\ < c[k, p, s)b^-'^} and {C{k, p, s)b^~'' < \\t\\ < 

1 /2 

Cob"'}, where a„ = , C{k, p, s) is as in Lemma 4.6 and t] G (0, k/2). Then, 
using Lemma 4.4, one can show (cf. Lemma 3.33 of [8]) that for all a G Z5|, 

C{s, \a\,p, k) 



(4.17) / \[D'^{Hn{t)-^sAt))Ko{b~''mdt< 

J\\t\\<ar, 



By condition C.2 and Lemma 4.6, for all a G Z^, 

/ |Z)"^,,„(i)|dt+ / \D''Hn{t)\dt 
J\\t\\>an J an<\\t\\<C(K,p,s)b^-'^ 

(4.18) 

< C{\a\,r],K)n 

Next, using condition C.6, one can show (cf. [22]) that for n> C{k), 
a / exp(-C7(K)(d„6V2)-2||i||2)^ < ^51/2^^^ 

Pin\t) ^ \exp(-C(K)6«/2), for ah b^^'^y^ < \\t\\ < Kb^l^dn- 

Hence, by Lemma 4.5 (cf. the proof of Lemma 3.43 of [8]), one gets 

(4.19) / \D''Hn{t)\dt<C{p,a,K)n-'. 

Jc{K,sp)b^-n<\\t\\<CQb^ 

Theorem 2.1 now follows from (4.16)-(4.19). □ 

Proof of Theorem 2.2. Let fn{x) = f{x + ESn) and jy G (0, 1/s). 
Then a proof of Theorem 2.1 can be constructed by using the arguments in 
[7] and the expansion 



fn{x) = 

0<|a| 



a|<s-2 \i=\ / 

+ (-e)^-i(s-l) ('iX-nr~''D''Ux^uet)dulU\a^\, 

with e = C({p(a) ■.\a\< s -\},K,p) ■ 6('?-i)/2 . See [22] for details. □ 

Proof of Theorems 2.3 and 2.4. Use (4.17)-(4.18), Lemma 4.7, and 
the arguments in the proof of Theorem 2.11 of [8]. See [22] for more details. 
□ 



Proof of Theorem 3.1. Let = {IJl^ - E\J\j ) , 1 < j < iV and Yjn = 
for + 1 < J < n. Then, by Theorem 2.4 and the stationarity of \Xi}iq%, 
it is enough to show that (i) limsup„_^oo ™^^i<j<b-^^s(^n) < °o, (ii) con- 
dition C.3 holds and (iii) lim„^oo Var(52n) exists and lies in (O,cxo). 
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By Lemma 3.3 of [17], Ehs{Ul^) < C{\u\){l + E\\Uuf'^) = 0(1), and 
hence, (i) holds. Next consider (ii). Let yJ^^^ = U^j^^l{\\Uij^rn\\ < cim) - 
EU^i, 1 < j < iV and Y^^^^ = for + 1 < j < n, where C/y, „ = [x]^^ + 
• • • + x'^-j^^_^)/\fi and cim = exp(Km/2|i^|), m > 1. Then, using the bound 
^||C/ii||2kl =0(1) (cf. Lemma 3.3 of [17]) and truncation arguments, one 
can show that 

+ ^l^7^;■||l(||c/^,„^|| <ci™)-i(||c/i,-|| < 

< C{u)[c[t'E\\Ui,,m - > Ci,„/2)] 

for ah 1 < J < A^, n > l,m > 1; see [22] for details. Hence, (ii) holds. 

Finally, consider (iii). Using (3.2), C.3 and C.4, one can show that 
Ef=£+3mlCov(C/ri,C^iVi))l =0(1)' whe^e ^= \C{K,s)logn]. Next let 
S{i,j) = Xi + ■ ■ ■ + Xj,i < j, r = , and for / C {1, . . . , r}, let Si{I) = 
nfcg7ifc'S'(l,i), where ti,.. .,tr are unit vectors such that C/f^ = 11^=1 ^fc^ij- 
Then the stationarity of the X^'s, (3.2), C.3 and C.4 yield (cf. [22]) 

^«^nC^ia+i) = i"' E E ^^i-^V4 {nES^^,^Mr)ESe-j {1)8,., (J) + Q,(j) 
/ J 

for < j < £_£i/2^ where Y.i and 

run over /, J C {1, . . . , t} and where 
max{|Q£(j)| <j<i- ^1/2} = ^g^t using the CLT, uniform inte- 
grability of Sf^ under (3.2), and the above expansion for EUiiW^f^j^-^^, one 

can show that Var(52„) = {nl)-^ E'Z%1{N - j) Coy{U^„U^^^^^^) + o(l) = 

A3(z^) + o(l) for some A3(i^) G (0,oo); see [22] for details. This completes the 
proof of (iii). □ 

Proof of Corollary 3.1. Without loss of generality (w.l.g.), we may 

set /X = 0. Then, 6^2 A„ = by^[f,n{2)- EUl,]-b^/^[finm^ + b'^'[mni2)? ^ 
Tin + + 6i/2[E(/i„(2)]2, say. Monotonicity of hc{x) = (1 + x''o)l{x > 
c),x G [0, oo) [for fixed c G (0, oo)] implies Ehc{\Tin + T2n\) < -E/ic (2 max{|ri„|, 
|T2n|}) < Ehc{2\Tin\) + Ehc{2\T2n\). Let £0 = (2A3(2) - A)/4. Then using the 
bound [£'(/in(l)]^ = 0{n~^) (cf. Lahiri [20]) and applying Theorem 3.1 to 
Ehc{\Tkn\) with c= [2{A3(2) + eo}(s-2)logn]^/2 fo^. k = l,2, one can prove 

the result. □ 

Proof of Theorem 3.2. Let aj = E{VeX2f, y}^ = {uf^)'^ - E{U^^^'^)'^ , 
l<j<b, 5g = b-y^EUYjl^ 51? = (nV2x„,sg)', where C/gl = 
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{X^j-i)e+i + ■■■ + Xj,)/Vi. Then = V^Xj[aj + ^-^/^^g _ b'\^X,^f] 
is a smooth function of Sh and hence, the EE for Tn can be derived from 
that of Sn (cf. Bhattacharya and Ghosh [2]). To derive an (s — 2)th order 

,[21 



EE for Sn , note that by (3.5) and the independence of {Vj :j G Z}, it is 

exists and is nonsingular; 



enough to verify (cf. [22]) 
(4.20) hm Cov(5|?])=h[^ 



(4.21) 



max sup E 



{/ jo+rrin ^ 
exp Lt' Y: <n 
^ j=jo-m„ , 



D 



JO 



< 1 



for some k G (0, 1), where Jn,Djo are as in C.6, ?ti„ = [C(k, s) logn] , An = 
{t gR"^ :k< \\t\\ < b^^~^^ and Wj^ is defined by replacing the l^n's in Wjn 
with y£l's. Using S.l and S.2(i)"(ii), one can show (cf. [22]) that (4.20) 
holds with E^^ = Diag(a^, 2ct^). 

Next consider (4.21). Set m„ = m for notational simplicity. Let U^j ^ = 

{Xj^_^_^y^^^^ H \-Xj^^^)/^/£ and cim = exp(K?n/4). Then it can be shown 

that uniformly over t E An and jo G J„ , 

jo+m 



sup E 



(4.22) 



< E\E{eM<Ul^o,m: Ko,™J')*)l^io}l + 2^(rio,mll > cim), 



where P*, = a{{Vj:j G Z, j ^ [(jo - l)^ + ?n+ 1, jo^-m]}) C Vj^. Next using 

the independence of the V/s, one gets £;|£;{exp(t(C/]j. [f/2i,m]^)*)l^i}l = 
-£^|'?j,m(i; Z{l2j))\ for some function ^j,m(i; -z); where for / C Z, .Z'(/) = {.Z'(i) : i E 
/} and where hj = {i e - l)i - m + 1 < i < (j - !)£ + m} U {i e 

Z:ji-m + l<i<j£ + m}. Let Zoo ~ A^(0, cj^). Then, for any e > 0, there 
exists C{e) G (0, oo) such that 



(4.23) 



sup{|£;exp(i(Zoo, Zi)t)| : ||i|| > e} < e 



Now using (4.23) and the EE results of [8], one can show that for any e > 0, 
sup{E|C,-„(t;Z(l2j))| :e < \\t\\ < h^'^^\j G J„} < exp(-C7(e)) + o(l); see [22] 
for details. Condition (4.21) now follows from (4.22), (4.23) and the above 
bound. □ 



Proof of Theorem 3.3. W.l.g., let EYin = for ah n G N. For 

= 0, . . . , iV - 1, let (A:) = iV-i E.=l' yinY^^+k)n■ Define al = [5° (0) + 
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2Efeii(l - N~^k)gl{k)]h/N and al = Eal, where we let Zn = b^/^{Yi 



EYN)/an- Then by Taylor's expansion, 

(4.24) TN = ZN-ZN[al-al]/[2al]+RiN = TiN + RiN, say, 
where, on the set {\al - al\ < al/2}, \Rin\ < -^(^n^i^l - (^l]^ + \Zn{^n 



al)\/[2al]. Next let 7?i„ = Yin[Y,n + 2E 



[2l]/\[N-i] 
k=l 



(1 - N-^k)Y^i+k)n], Vi 



riun - Er]un, i = 1, . . . ,iV and Vi{ii) = S{[{i - l)U + 1], [iA^ A iV]), where 
S{p, q) = Y^1=pflin for any 1 < p < q < N . Then, using the weak dependence 

of alternate Fj(4£)'s and Markov's inequality, with e„ = 6~^/^(logn)^^, one 
gets 

P(\al - all > 2e.n.) 



<P 



(4.25) 



l<2i<N/[ie] 



l<2i-l<N/[Ae\ 

< C[enNyb]^^[e\N/[A£]f 



> SnN^/b 



0{b~\logny 



Also, by moderate deviation bounds for Y/v and Markov's inequality, P{\d: 
al\>Cb-'/\\og 



2) = 0{b- {log n)-^) and hence, by (4.24)-(4.25), Tn 
and Tijv have identical EEs up to order o(6^/^). With a = a„ = [b^^'^f 



write Z, 



N 



over Yinb for i = 1, . . . , 2al and Sn ^ over "^brnr, 
can be shown that 



Sn^ + si^^ , where Z^^^ denotes the sum 



1, . . . , 2a^. Then it 



(4.26) Tin = Z 



N 



Z^^\^^'^ /[2al] + R2N = T2N + R2N, 



where P(|i?27v| > ^-^/^mg ^/^) = 0{am"^'yb) = o[ 



1/2 



have identical EEs up to order o{b ^/^). 

Next define the EE \I'„,(x) for T2N by its Fourier transform. 



say, 

/^). Thus, T/v and T2Ar 



^n(t) 



exp(tte) (i^n(2;) 



(4.27) 



: exp(-tV2) 



l+E{itZnf/6 



+ 5-3/2 ^ ^ {it)EZ,nVjnTnii,j) 
i=a+l j=a+l 

where 60 = ^(2^)1 and for 1 < i,j < 60, Z,n = ^^^'""YlUY^i-m+k, 
Vjn = -N-%''~S{[{i-l)2l + ll[2i^^N])/[2ul] and r„(i, j) = Er=i(r!)-i x 
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[itGn{i,j)Y , with Gn{i,j) denoting the sum over all {Zknb~'^^'^:\i-k\ < 1, 
|j — A;| < 1, 1 < A; < 6o}- Also, let Qn = —Z^^Sn^/[2a'^], the quadratic part 
of T2N- Using arguments in the proofs of Lemma 4.5 above and Lemma 3.5 
of Lahiri [19], one can show that 



(4.28) 



EBj^{t) exp it ^ Zjn/ Vb 
\ j=i / 

< Ci[exp(-C2a/m3)l(|t| > ^6^/^) 

+ exp{-C3t'^a^ /[bm3])l{\t\ < Kb^^^)] 

bo 



for some constants Cj = Ci{a^,K), where 3^(1) = 'n.j'La+i{Ilk=ii^ + '^kjZjn + 



PkjVjn)} exp{LtZjn) for some akj,/3kj G [-1, 1] and rj £ Z+ with Ejia+i 
+ < 4. By Taylor's expansion, for t G R, 



'J 

^k=l 



E exp{UT2N) = E exp{LtZN) 



1 + LtQN 



(4.29) 



+ 2-^{LtQN)^ [ exp{LutQN) 
Jo 

i'n{t)+R3n{t), 



du 



where, using (4.28) and Lemma (3.30) of [8], one can show that \R3n{t)\ < 
C{\t\^ + |t|4)6-V2-'^ for some 6 G (0, 1/2). 

Now using Esseen's smoothing inequality (cf. Chapter 15, Feller [5]) over 
the interval {|t| < 6"'^/^logn} and using (4.29) for \t\ < (logn)^, the second 
term on the right-hand side of (4.28) for \t\ G ((logn)^, and the first 

term on the right-hand side of (4.28) for \t\ > nb^^'^, one can conclude that 



(4.30) 



sup\P{TN<x)-^nix)\ = o{h 



-l/2x 



Next we derive an EE for the bootstrapped Studentized statistic. Let 



and = 61-1/2 



i^*n> where 



% = iil/iy/'[Y*n,l-p'n,l],Z 

Y^^i is the average of the ith resampled BOBB block (of size ii), fin,! = 
E^Yi^i and (t^ = Var^,(Z*„). Using Taylor's expansion and moderate devi- 
ation inequalities for sums of independent random variables, one can show 
that 



In 



z 



N 



bi 



6r^E{(%)'-'^n} 



(2<) + i? 



IN 



= Tij^ + Rlj^, say. 
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where = {al > al^/2}n{E^\Z*^\^'' < C} and P^{\Rl^\ > b^^/^{\ogny^) < 
Cb-^/"^ (loglogny^. Next define T*^ by deleting the first oi = \bi^^-'^°'^^ 
many Z*^^s from the quadratic term in Tj*^, where a = ■ 



(l-55o) 



Let 



^2N 



-'-IN 



TXat- Then, with e„ 



unbootstrapped case, one can show that on the set A^, 



using arguments similar to the 



(4.31) 



P,{\R*2n\ > 3en6r'/2) < 3ai{elbi}~\ 



0(6-i/2(logn) 



Here the choices of oi and e„ ensure that [enfer"^/^]V[4i- 
Next define the EE ^nix) for (and also for T^) by its Fourier transform, 



(4.32) 



exp{-r/2) 



l + E4itZlJ'/[6Vb 



i=ai+l j=ai+l 



x{-2a3}-ir:(i,j)) 



where F* (i, j) = J2l=i{r\)^^[itG^{i,j)Y, with Gn{i,j) denoting the sum over 
all {Z^^b~^/^ : k G Using the independence of the ^*„'s, the moment 

condition and Taylor's expansion, one can show (cf. Gotze [6]) that on the 
set An . 



(4.33) 



\E,eM'^tT*^)-n{t)\ 

\t\<m3 \t\ 



dt<Cb^^^ 



dt 



|t|<m3 



< Cbi~^m\. 



Since the integral of |^* (t)| over {\t\ > ms} is 0(exp(— Cm^)), in view of 
Esseen's lemma, it is enough to consider the integral of |£'=k exp(ttT2^)| 
over {t : < \t\ < bi} (say). Let Qjv denote the quadratic part in T^^y- Then 



(4.34) 



\E^ exp{LtT2N)\ 

= E^, exp{LtZ^ 




ro! 



exp(tut(5jv) du 
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Note that by the independence of the ^^^'s, the rth summand above for 
r G {0, . . . , ro — 1} is bounded above by Ci(r)(6i)''|t|^ exp(— C2(r)t^), while 
the last term is bounded above by Ci|t|'''' exp(— C2ait^/6i). Hence 

(4.35) / |ii;,exp(.tr2V)|^<CN-(l/2-a)ro[^3]ro^^( 
"'m.-i<|i|<fei"ms I 



Jm3<\t\<bi°'m:j 

Next, using the independence of : k = 1, . . . ,ai} and Q*j^, one can show- 
that IE'* exp(itT|^)| < exp(— Ct^ai/6i) for all |i| < Kbi^^^, for some k > 0, 
so that 



(4.36) 



/ \t\-'^\E^exp{itT^j^)\dt 

JbT°'m;<\t\<Kb^'^^^ 



/bi"m3<|t|<Kfeii/2 
r;, 11—20 

< Ciii^exp(-C2?n2ai[&i]2"-i) < Cgmg ^ exp(-C4mi). 



Finally, consider |t| G ft^/-^ logn]. For any e > 0, 

sup{|£'exp(itZ*„)| :e < |t| < 61} 

r JVi 

iVri^[exp(.ty,„,i(£i/£)V2) 



< sup-^ 



1=1 



(4.37) -^exp(6tyi„,i(£i/^)V2)j 



■.e <\t\<bi 



+ sup{\Eexp{LtYin,i{ii/i)^^^)\:e <\t\ <bi} 

= IiN + hN, say. 

Using a discretizing argument as in Lemma 4.2 of Babu and Singh [1], one 
can show (cf. Lahiri [19]) that 

(4.38) P(/ijv > (log[n + 1])-^) ^0 asn^oo. 

Note that Fin,i(^i/^)^/2 = (^1/^)^'/' ^'in, where Yin = r ^ E};'"' l^j„, 
[cf. (2.1)]. Next, using Theorem 4.1 [with /(•) = exp(it(-))] for K<\t\< 
\t\l€)^l'^ and Lemma 4.5 and condition (iv) for |t| > (£i/£)^/^, one can show 
that there exists a At G (0, 1) such that 

(4.39) hN < (1 - ^) 

for ah n > k"^ . Hence, by (4.31)-(4.39), it follows that 

(4.40) sup I (T;^ <x)-v^„(x) I = op (6^1/2 

Next comparing the EEs for T/v and T^, using the blocking arguments 
as in derivation of (4.25) and observing that 6i~^/^£^{(£i/i')^/^Yi„^i}^ = 

[6r^/'^i/^)"^/2]x[(4/^)-ii?{Et'?>^-}'] = ^"'/'[&-'^{Eti>^m}'](i+«(i)), 

one can complete the proof of (3.8). □ 
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